Open Peer Reviews and Blind Peer Reviews: Merits and Demerits

Disadvantages of Peer Reviews

Peereviz: Visualizing Peer Reviews

Peer reviews is one possible solution in scaling assessment of open-ended assignment in massive online open courses. However, the amount of data from peer review process is huge and it becomes difficult to explore and understand. In this paper, we present Peereviz, an exploration tool for largescale peer review that helps course instructors to understand and gain insights from the peer review a...

Incentivizing anonymous “peer-to-peer” reviews

The review cycle for papers takes way too long in many disciplines. The problem is that while authors want to have their own papers reviewed fast, that are often unwilling to review the papers of others in a timely manner. This paper explores what would be required to incentivize fast reviews using a public reputation/scoring system that exploits the fact that the referees are drawn from the sa...

Aggregating post-publication peer reviews and ratings

Allocating funding for research often entails the review of the publications authored by a scientist or a group of scientists. For practical reasons, in many cases this review cannot be performed by a sufficient number of specialists in the core domain of the reviewed publications. In the meanwhile, each scientist reads thoroughly, on average, about 88 scientific articles per year, and the eval...

Sentiment-Oriented Summarisation of Peer Reviews

It is common that students peer-review other students’ writing, and these reviews are useful information to instructors, both on the particulars of the essay being reviewed, the feedback provided and the overall progress of the class. This paper describes a novel approach to summarising feedback in academic essay writing. We present a summarisation method for identifying and extracting represen...